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(54) Disk subsystems and their integrated system 



(57) An asynchronous renrwte copy system is pro- 
vided which can ensure the data renewal order and data 
integrity of the disk subsystenns and are easy to be 
incorporated and free from degradation of the process 
performance of host computers (1, 11). To this end, in 
the remote copy system for data mirroring, a main 
center (12) has one gateway subsystem (5) and a 
remote center (13) has one gateway subsystem (7), and 
disk subsystems(3, 9) in each center to be remotely 
copied are connected to the corresponding gateway 
subsystem. Data is mirrored through synchronous type 

FIG.1 
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remote copy between a volume of the disk subsystem of 
each center to be remotely copied and a desired volume 
of the corresponding gateway subsystem, and the gate- 
way subsystem of the main center sends the renewal 
data to the gateway subsystem of the remote center in 
accordance with the order of renewal of volumes of the 
gate way subsystem of the main center, to make the 
gateway subsystem of the remote center reflect the 
renewal data upon the volumes thereof through asyn- 
chronous type remote copy. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present Invention relates to externa! 
storage devices for storing data in a computer system 
and to their integrated system, and more particularly to 
remote copy techniques for min-oring data between 
remote external storage devices (disk subsystems) 
without involving an upper hierarchical apparatus or 
host computer, by interconnecting remote external stor- 
age devices and other remote external storage devices. 
The disk subsystem Is herein Intended to mean a con- 
trol unit for controlling data transfer to and from an upper 
hierarchical apparatus and a storage device having 
disks for storing data or a storage devk:e having an 
Intemal buffer. 

[0002] External storage systems Incorporating a 
so-called remote copy function have already been In 
practical use, in which data is mirrored and stored in 
disk subsystems of a main center and a remote center. 
[0003] Such prior art has various issues to be 
solved because the remote copy function Is realized by 
involving host computers. 

"Synchronous Type and Asynchronous Type" 

[0004] The remote copy function is mainly classified 
into two types, a synchronous type and an asynchro- 
nous type. 

[0005] The synchronous type executes the follow- 
ing process sequence. When a disk sut)system Is 
instructed by a host computer (upper hierarchical appa- 
ratus) of a main center to renew (write) data and if the 
disk subsystem is assigned the remote copy function, a 
renewal process completion nottee Is issued to the host 
computer of the main center only after the instructed 
data renewal (write) is completed for a corresponding 
disk subsystem in a remote center. A time delay (trans- 
mission time and the like) is generated in accordance 
with a geographical distance between the main center 
and remote center and the performance of a data trans- 
mission line therebetween. If the transmission time of 
the synchronous type is taken into consideration, sev- 
eral tens Km is a practical limit of a distance to a remote 
site. 

[0006] In the synchronous type, the data contents in 
disk subsystems in the main and remote centers are 
always consistent from a macro viewpoint. Therefore, 
even if the function of the main center is lost by acci- 
dents or the like, the data contents immediately before 
the accidents are perfectly retained in the disk subsys- 
tems of the rennote center and the process can be 
resumed quickly at the remote center. The term "always 
consistent from the macro viewpoint* means that during 
the execution of the synchronous type function, 
although the data contents may be different in terms of 
a process time (-sec, msec) of magnetic disk devtees 



and electronic circuits, the data contents are always the 
same at the time of data renewal completion. This is 
because the renewal process at the main center cannot 
be completed unless the renewal data is completely 

5 reflected upon the remote center Therefore, in some 
cases, particularly if a distance between the main and 
remote centers is long and the data transmission line is 
congested, the access performance to a disk subsys- 
tem in the main center is considerably degraded. 

10 [0007] In contrast, the asynchronous type executes 
the following process sequence. When a disk subsys- 
tem Is instructed by a host computer of a main center to 
renew (write) data and even if this data is to be remotely 
copied, a renewal process completion notice is issued 

IS to the host computer of the main center immediately 
after the data renewal process for the disk subsystem in 
the main center ts completed, to thereafter execute the 
data renewal (reflection) of the disk subsystem in the 
remote center, asynchronously with the data renewal in 

20 the main center. Since the data renewal is completed in 
a process time required by the main center, there is no 
transmission delay time or the like to be caused by stor- 
ing the data in the remote center. 
[0008] In the asynchronous type, the data contents 

25 in a disk subsystem of the remote center are not always 
consistent with those in the main center. Therefore, if 
the function of the main center is lost by accidents or the 
like, the data still not reflected upon the remote center is 
lost However, an access perfomnance of a disk subsys- 

30 tem in the main center can be maintained at the level 
when the remote copy function is not executed. 
[0009] In order to back up data so as not to be lost 
by natural disasters such as earthquakes, it is neces- 
sary to set the distance between the main and remote 

35 centers to about 1 00 km to several tens km. Although it 
Is possible to use a high speed communication fine, for 
example, of a 1 00 Mblt/sec to 300 Mbit/sec class for the 
remote copy function, an expensive line subscription fee 
Is Incunred upon a customer of the disk sut)system, and 

40 this approach is not economtoally suitable. 

■Order Integrity" 

[0010] There is another problem different from the 
45 above-described issue of the data transmission time. 
Namely, if the remote center backs up the data of a plu- 
rality of disk subsystems of the main center, there 
occurs an issue (order Integrity) that disk subsystems 
are required to be in one-to-one correspondence. In 
50 asynchronous remote copy, It is inevitable that reflection 
of renewal data in the remote center is delayed from the 
time when an actual renewal process is executed in the 
main center. However, the order of renewal in the 
remote center is required to be the same as that In the 
55 main center. 

[0011] A database or the like is generally consti- 
tuted of a main body of the database and various log 
and control information directly associated with the 



2 



3 



EP1 049 016A2 



4 



main body. When data is renewed, not only the data- 
base nnain body but also the log and control Infomnation 
is renewed to maintain the system integrity. Therefore, if 
the renewal order is not kept, the integrity of information 
regarding the renewal order Is also lost, and at the worst 5 
the whole of the database may be destructed. 

"Involvement of Host Computer" 

[0012] In the asynchronous remote copy under 
general environments where the main and remote cent- 
ers have a plurality of disk subsystems, when the host 
computer instructs the disk subsystem to renew data, it 
Is common that the host computer adds renewal order 
information such as a time stamp to the data to make 
the corresponding disk subsystem in the remote center 
execute a renewal data reflection process in accord- 
ance with the added information. 
[0013] According to the remote copy function dis- 
closed, for example, in the publk:ation of JP-A-6-290125 
(U.S. Patent No. 5,446.871), generation and supply of 
renewal order information and a renewal data reflection 
process based upon this information are realized 
through the cooperation between the operating system 
of a host computer in a main center and its disk subsys- 
tems and the operating system of a host computer in a 
remote center and its disk subsystems. 

SUMMARY OF THE INVEm"ION 

[0014] This prior art can realize the asynchronous 
remote copy function while ensuring the renewal order 
between main and remote centers. With this prior art, 
however, both the upper level software and a disk sub- 
system are required to have the mechanism for realizing 
the remote copy function, and also they are required to 
operate in cooperation. Since new custom software is 
required to be incorporated, a user is necessary to per- 
form works such as software incorporation, setting and 
check, and modifteation of system designs to be caused 
by an increased CPU load. Incorporation of this conven- 
tional function is, therefore, associated with some 
obstacles such as a predetermined work period for such 
preparation and a cost therefor. 

[0015] If the asynchronous remote copy function is 
executed when the capacity of the communication line 
to a remote center is not sufficient, renewal data not 
reflected upon the remote center increases. 
[0016] It is an object of the present invention to real- 
ize an asynchronouos type remote copy function capa- 
ble of ensuring a renewal order and data integrity and 
facilitating its incorporation with less performance deg- 
radation of a main center, by using only the function of a 
disk subsystem without incorporating new software. 
[001 7) It is another object of th e present invention to 
realize a remote copy function without incurring an 
expensive line subscription fee upon a customer of a 
disk subsystem, by applying an asynchronous type 



remote copy function to the disk subsystem capable of 
storing a large amount of data. 

[001 8] Each of a main center and a remote center is 
provkied with a disk subsystem serving as a gateway 
(hereinafter called a gateway subsystem) which is con- 
nected to a data transmission line. All disk subsystems 
in both the centers to which a remote copy is executed, 
are connected to the con^esponding gateway subsystem 
of each center. 

[0019] A volume of the disk subsystem in the main 
center to be remotely copied and a desired volume of 
the gateway subsystem in the main center are coupled 
by a synchronous type remote function to mirror data. If 
a system process time delay or the like can be 
neglected between the volume of the disk subsystem in 
the main center to be remotely copied and the volume of 
tiie gateway subsystem in the main center, data consist- 
ency can be retained. 

[0020] Data is min-ored between volumes of the 
gateway subsystems of the main and remote centers 
through asynchronous remote copy. In this case, the 
gateway subsystem of the main center sends renewal 
data to the gateway sut>system of the remote center in 
accordance with the renewal order of volumes of disk 
subsystems of the main center, whereas the gateway 
subsystem of the remote center reflects the renewal 
data upon corresponding volumes of the remote center 
in accordance with the reception order of the renewal 
data. 

[0021] Data is mirrored between the volume of the 
gateway subsystem of the remote center and the vol- 
ume of each disk subsystem through synchronous 
remote copy. Data same as from a macro viewpoint Is 
always stored In the volume of the gateway subsystem 
of the remote center and in the volume of the disk sub- 
system to be remotely copied. 

[0022] The gateway subsystem stores data in the 
volume to be remotely copied, in a buffer memory of the 
gateway subsystem. Since the gateway subsystem has 
the buffer memory, generally an area for storing data in 
the gateway subsystem Is not necessarily required. 
However, if there is an available area in the gateway 
subsystem, this area can be utilized for data transfer via 
the transmission line, depending upon the capacity of 
the transmission line. 

[0023] With the above-described configuration, it is 
possible to mirror data between a plurality of disk sub- 
systems of the main center and a plurality of disk sub- 
systems of the remote center, by using the furrctions of 
the disk sut>systems, while the data renewal order is 
retained. Reflection of renewal data upon the remote 
center can be performed asynchronously with the data 
renewal process at each disk subsystem of the main 
center. It Is therefore possible to provide a disaster 
resistant back-up system of high performance and easy 
incorporation. Depending upon the communication 
capacity of the transmission line, the storage area of the 
subsystem can be utilized so that a burden of a line sub- 
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scrlptlon fee of a customer can be reduced. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0024] 5 

Fig. 1 is a diagram showing the overall structure of 
a remote copy system according to an embodiment 
of the invention. 

Fig. 2 is a flow chart illustrating the details of an io 
operation of the remote copy system. 
Rg. 3 is a flow chart illustrating the details of an 
operation of the remote copy system to follow the 
flow chart of Fig. 2. 

Rg. 4 IS a flow chart illustrating the operation of a is 
remote copy system having a gateway subsystem 
provided with a buffer area. 
Fig. 5 is a diagram showing the internal structure of 
a gateway subsystem. 

20 

DESCRIPTION OF THE EMBODIMENTS 

[0025] An embodiment of the invention applied to a 
general computer system will be described with refer- 
ence to the accompanying drawings. 25 
[0026] Rg. 1 shows an example of the structure of a 
system embodying this invention and allowing data to 
be min-ored between arbitrary two data centers among 
a plurality of data centers each provided with a general 
computer system. 30 
[0027] One or a plurality of disk subsystems in a 
main center and one or a plurality of disk subsystems in 
a remote center are interconnected via gateway subsys- 
tems without involving the host computers, to realize a 
remote copy system for min-oring data between both the 35 
centers. 

[0028] In the main center 1 2 shown in Fig. 1 , a cen- 
tral processing unit (host computer) 1 is connected via 
interface cables 2 to disk subsystems 3-1, 3-2, .... 3-n. 
The disk subsystems 3-1 . 3-2, .... 3-n store data to be 4o 
refenred to, or renewed, by the host computer 1. The 
gateway subsystem 5 is connected via interface cables 
4 to the disk subsystems 3-1 to 3-n. 
[0029] The gateway subsystem 7 is provided in the 
remote center 13 and connected via an interface cable 45 
6 to the gateway subsystem 5 of the main center 12. 
The interface cable 6 is connectable to a general com- 
munication line. In this embodiment, therefore, the inter- 
face cable 6 is intended to include such a function. 
[0030] When the host computer 1 issues a data so 
write request to a disk subsystem 3-1 or the like, the 
disk subsystem 3-1 or the like writes the data in its 
buffer memory. Synchronously with this timing the disk 
subsystem 3-1 or the like issues a data write request to 
the gateway subsystem 5. ss 
[0031] Upon reception of this write request, the 
gateway subsystem 5 writes the data In its buffer mem- 
ory. Asynchronously with the data write in the buffer 



memory of the gateway subsystem 5, the gateway sub- 
system 5 issues a data write request to the gateway 
subsystem 7 at the remote site. It is essential to use 
only one gateway subsystem 5 irrespective of how 
many disk subsystems 3-1 to 3-n are used. 
[0032] The gateway subsystem 7 stores data sup- 
plied from the gateway subsystem 5 in its buffer mem- 
ory, in the order of data write requests. It is essential to 
use only one gateway subsystem 7. 
[0033] Disk subsystems 9-1, 9-2, 9-n are con- 
nected via interface cables 8 to the gateway subsystem 
7. When a data write request is issued from the main 
center 12 to the gateway subsystem 7, synchronously 
with this timing the gateway subsystem 7 writes the data 
therein and in the disk subsystem 9-1 . 
[0034] Remote copy is therefore executed by 
sequentially issuing a write request to a subsystem and 
then to the next subsystem. When a data write request 
is issued from the host computer 1 to one or a plurality 
of disk subsystems 3-1 to 3-n, the same data is loaded 
in one or a plurality of disk subsystems 9-1 to 9-n of the 
remote center 13. Arrows shown in Rg. 1 Indfeate the 
flow of the data Instructed to be written by the host com- 
puter 1. 

[0035] In the remote center 13, the host computer 
1 1 is connected via Interface cables 1 0 to the disk sub- 
systems 9-1 to 9-n, and is a central processing unit 
which executes data reference and renewal relative to 
the disk subsystem 9-1 or the like. When the host com- 
puter 1 of the main center 1 2 cannot provide its intrinsic 
functions because of disasters, system failures or the 
like, the host computer 1 1 can operate as an alternative 
to the host computer 1. In addition, the host computer 
1 1 can execute a process different from that of the host 
computer 1 of the main center 12 by using data stored 
in the disk subsystem 9-1 or the like, independently 
from the operation of the host computer 1 . However, if 
the host computer 1 1 does not execute a process by 
using the disk subsystem 9-1 , this host computer 1 1 Is 
unnecessary. 

[0036] The outline of the data mirroring method and 
operation according to the embodiment of this invention 
will be described with reference to Rgs. 2 and 3. 
[0037] A volume, a data set and a disk subsystem 
which store data to be mirrored are preselected by an 
administrator. The relation between the volume, data 
set and disk subsystem In which the data is stored and 
a volume, a data set and a disk subsystem which store 
a copy of the data, is preset to the disk subsystems by 
the administrator from the host computers. 
[0038] In other words, a write destination of data to 
be copied is determined sequentially between respec- 
tive disk subsystems described above. For example, 
when data is written in a volume of the disk subsystem 
3-1 , it is set in such a manner that in which volume of 
the gateway subsystem 5 the data is written from the 
disk subsystem 3-1 . then in whteh volume of the gate- 
way subsystem 7 the data Is written from the gateway 
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subsystem 5, lastJy in which volume of the disk subsys- 
tem 9-1 the data is written from the gateway subsystem 
7. Such settings are provided for each disk subsystem 
including the gateway disk subsystem. 
[0039] For such settings, the serial number and vol- 
ume of each disk subsystem are used. For example, a 
volume A of the disk subsystem 3-1 is set to a volume B 
of the gateway subsystem 5, the volume B of the gate- 
way subsystem 5 is set to a volume C of the gateway 
subsystem 7, and the volume C of the gateway subsys- 
tem 7 is set to a volume D of the disk subsystem 9-1 . In 
this manner, the data written in the volume A of the disk 
subsystem 3-1 is copied to the volume D of the disk 
subsystem 9-1. This setting is conducted for all vol- 
umes. 

[0040] Such preselect and preset may be effected 
by using a console or a servk^e processor without using 
the host computer, if the disk subsystem can be con- 
nected to or provided with its console or service proces- 
sor. The flow chart shown in Fig. 2 illustrates the 
operation assuming that the host computer is used for 
such preselect and preset. 

[0041] For such preset, a specific address indicat- 
ing the volume or disk subsystem may be designated, or 
the volume or disk subsystem in an arbitrary address 
range may be selected by using a control program in the 
disk subsystem. Path setting and pair setting are used 
as an example of initial setting (Rg. 2, 201). 
[0042] The further description will be given with ref- 
erence to the accompanying drawings. 
[0043] As the host computer 1 (Rg. 1 ) issues a data 
write request (hereinafter called a write command) to 

the disk subsystem 3-1, 3-2 3-n (21 1) (Rg. 2. 202), 

the disk subsystem 3-1, 3-2, 3-n executes a data 
load process for loading the write data therein in 
response to the write command, and also issues a write 
command for the data to the gateway subsystem 5 
(212) (203). The write command is a command for 
transferring an instruction of data write and the write 
data itself. 

[0044] Upon reception of the write command, the 
gateway subsystem 5 executes a process correspond- 
ing to the write command (204). After the gateway sub- 
system completes a data load process for loading the 
data in its buffer memory, it notifies a process comple- 
tion to the disk subsystem 3-1 , 3-2, .... 3-2 (21 1). A write 
command number is assigned to each write command 
in the order of the process completion (205), and at the 
timing detemiined basing upon the processing capabil- 
ity of the gateway subsystem 5, the write command 
assigned the write command number is issued to the 
gateway subsystem 7 (213) in the order of the write 
command number (206). 

[0045] Under the conditions that the disk subsys- 
tem 3-1, 3-2, 3-n completes a process for the write 
command issued from the host computer 1, i.e., com- 
pletes a data load process for loading the data therein, 
and receives a write process completion notice from the 



gateway subsystem 5 (212) (221), the disk subsystem 
supplies a write comrriand process completion notice to 
the host computer 1 (222). 

[0046] The gateway subsystem 7 (213) confirms, 

5 from the write command numbers assigned to respec- 
tive write commands issued from the gateway subsys- 
tem 5 (212), whether the write commands have been 
received in the order of the assigned write command 
numbers. Thereafter, the gateway subsystem executes 

10 the processes corresponding to the write commands, 
i.e., executes a data load process (301) for loading the 
data in its buffer memory. Thereafter, a write command 
corresponding to the loaded data is issued to the corre- 
sponding disk subsystem 9 (31 1) (302). Upon reception 

15 of the write command issued from the gatew^ sut)sys- 
tem 7, the disk subsystem 9 (311) executes a process 
corresponding to the write command, i.e., executes a 
data load process for loading the data therein (303). 
[0047] After the disk subsystem 9-1, 9-2 9-n 

20 (311) completes the process corresponding to the write 
command, i.e., completes the data load process for 
loading the data in its buffer memory, it supplies a proc- 
ess completion notice to the gateway subsystem 7 
(321 ). Under the conditions that the gateway subsystem 

25 7 (21 3) completes the data load process for loading the 
data therein and receives the write process completion 
notice from the disk subsystem 9-1, 9-2,..., 9-n, the 
gateway subsystem 7 supplies a process completion 
notice for the write command to the gateway subsystem 

30 5 (322). 

[0048] According to the present invention, data writ- 
ten by the host computer 1 is min-ored between the disk 
subsystem 3-1 , 3-2, 3-n and the gateway subsystem 
5 and is maintained consistent from a macro viewpoint. 
35 At this time, the gateway subsystem 5 adds Information 
(serial number) to the data In order to hold the renewal 
order. 

[0049] Data is mirrored between the gateway sub- 
systems 5 and 7 through asynchronous remote copy 

40 while the renewal order is ensured. Synchronously with 
the data renewal by the gateway subsystem 7, the disk 
subsystem 9-1, 9-2, .... 9-n renews the data. These 
operations are all realized by only the functions of the 
disk subsystem including a disk subsystem having the 

45 gateway function so that any load is not applied to the 
processing performance of the host computer. 
[0050] The operation of the remote computer sys- 
tem which uses a buffer area of each gateway subsys- 
tem when the communication capacity of the 

50 transmission line is not sufficient, will be described with 
reference to Fig. 4. in Rg. 4, blocks having identical ref- 
erence numerals to those shown in Figs. 2 and 3 have 
been already described above. In this system, a buffer 
area for temporarily storing write data is provided at 

55 each gateway subsystem in order to prevent an overflow 
of a buffer memory for a general transmission line. Data 
stored in the buffer area of the subsystem is sent from 
the main center 12 to the remote center 13 via the trans- 
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mission line, and to the gateway subsystem via the 
buffer area on the side of the remote center 12. 
Although time consistency for mirroring is degraded, the 
asynchronous type remote copy function can be real- 
ized without using a high capacity communication fine. 
[0CS1] Fig. 5 shows the structure of the gateway 
subsystem 5. The structure of the gateway subsystem 7 
is the same as the gateway subsystem 5. 
[0052] The gateway subsystem 5 has: an interface 
control unit 1 1 for data (including information) transfer to 
and from the disk subsystem 3-1 or the like and the 
gateway subsystem 7; a data buffer 12 for temporarily 
storing the data; a magnetic disk drive 13 as a storage 
medium for storing the data; a control memory for stor- 
ing remote copy status information (as to which volume 
of which disk subsystem is written to which volume of 
the gateway subsystem 5, as to whk^h volume of the 
gateway subsystem 5 is written In which volume of the 
gateway subsystem, and the like); a microprocessor 14 
for controlling transfer of these data; a service proces- 
sor panel 15 allowing a user to set how the remote copy 
is executed; and a disk array subsystem control unit 17 
for controlling these components. In this example, 
although the data buffer 12 is provided at the gateway 
subsystem 1 2, this data buffer 1 2 is not necessary if a 
cache memory capable of performing a similar function 
to the data buffer 12 is provided, because the cache 
memory can function as the data buffer 12. In this spec- 
ification, therefore, the data buffer 1 2 is intended to be 
inclusive of such a cache memory. Also in this example, 
although the control memory 1 6 is provided at the gate- 
way subsystem 5, this control memory 16 is not neces- 
sary if a remote copy control information storage unit 
capable of performing a similar function to the control 
memory 1 6 is provided, because the remote copy infor- 
mation storage unit can function as the control memory 
16. In this specification, therefore, the control memory 
16 is intended to be inclusive of such a remote copy 
information storage unit. 

[0053] As described so far, according to the present 
invention, an asynchronous type remote copy system 
can be realized whk;h can ensure the data renewal 
order and data integrity by using the functions of disk 
subsystems without incorporating new software and 
which is easy to be incorporated and free from degrada- 
tion of the process performance of the main center. 
[0054] A storage area of the subsystem can be 
used depending upon the communication capacity of 
the transmission line so that a burden of a line subscrip- 
tion fee of a customer can be reduced. 

Claims 

1. A system having a plurality of subsystems (3, 9) 
connected to an upper hierarchical apparatus (1, 
11), comprising: 

a gateway subsystem (5, 7) having a buffer 



memory for storing data supplied from said plu- 
rality of subsystems and an interface for con- 
nection to another system having other 
subsystems for writing the data therein. 

5 

2. A system according to claim 1 , wherein said gate- 
way subsystem stores data supplied from said plu- 
rality of subsystems and writes data into the other 
system, asynchronously. 

10 

3. A system according to claim 1 , wherein said gate- 
way subsystem adds order information of data to be 
transferred to the other system. 

15 4. An integrated system comprising: 

the other system (13) having a second gateway 
subsystem for receh/ing a write request sent 
from said gateway subsystem and a plurality of 
20 subsystems connected to the second gateway 

subsystem; and 

the system (12) redted in claim 1. 

5. An integrated system according to claim 4, wherein 
25 the other system ts located at a remote site. 

6. An integrated system according to claim 4, wherein 
the other system is connected by a communication 
line. 

30 

7. An integrated system according to claim 1 or 6, 
wherein the subsystem is a disk subsystem. 

8. A data copy method comprising the steps of: 

35 

receiving a write request for data from an upper 
hierarchical apparatus (1) at a subsystem (3) of 
a first subsystem group; 
writing the data in a first gateway subsystem 
40 (5); 

writing the data written in the first gateway sub- 
system in a second gateway subsystem (7); 
and 

writing the data in a subsystem (9) of a second 
45 subsystem group from the second gateway 

subsystem. 

9. A data copy method according to claim 8, wherein 
writing data from the upper hierarchteal apparatus 

50 into the subsystem and writing data from the sub- 
system into the first gateway sut)system are exe- 
cuted synchronously. 

10. A data copy method according to claim 8, wherein 
55 writing data from the subsystem Into the first gate- 
way subsystem and writing data from the first gate- 
way subsystem into the subsystem of the second 
subsystem group are executed asynchronously. 



6 



11 EP 1049 016 A2 12 

11. A data copy method according to claim 10, further 
comprising a step of adding a number to data in the 
order of data write into the first gateway subsystem. 
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